Multi-modal Retinal Image Registration Using a Keypoint-Based Vessel Structure Aligning Network
نویسندگان
چکیده
In ophthalmological imaging, multiple imaging systems, such as color fundus, infrared, fluorescein angiography, optical coherence tomography (OCT) or OCT are often involved to make a diagnosis of retinal disease. Multi-modal registration techniques can assist ophthalmologists by providing pixel-based comparison aligned vessel structures in images from different modalities acquisition times. To this end, we propose an end-to-end trainable deep learning method for multi-modal image registration. Our extracts convolutional features the structure keypoint detection and description uses graph neural network feature matching. The jointly trained self-supervised manner using synthetic pairs guided synthetically sampled ground truth homographies. demonstrates higher accuracy competing methods our dataset generalizes well real macula public fundus dataset.
منابع مشابه
Multi-modal 3d Image Registration Using the Kullback-leibler Distance
In this paper we address the problem of multi-modal coregistration of medical 3D images. Several techniques for the rigid registration of multi-modal images have been developed; in one of those the Kullback-Leibler distance is used to align 2D-3D angiographic images [1]. In this paper we refine this technique and investigate its performance on the registration of pairs of 3D CT/US images. We te...
متن کاملMulti-modal Image Registration Using Polynomial Expansion and Mutual Information
The use of polynomial expansion in image registration has previously been shown to be beneficial due to fast convergence and high accuracy. However, earlier work has only been for mono-modal image registration. In this work, it is shown how polynomial expansion and mutual information can be linked to achieve multi-modal image registration. The proposed method is evaluated using MRI data and sho...
متن کاملMulti-modal Image Registration Using the Generalized Survival Exponential Entropy
This paper introduces a new similarity measure for multimodal image registration task. The measure is based on the generalized survival exponential entropy (GSEE) and mutual information (GSEE-MI). Since GSEE is estimated from the cumulative distribution function instead of the density function, it is observed that the interpolation artifact is reduced. The method has been tested on four real MR...
متن کاملMulti-modal registration for correlative microscopy using image analogies
Correlative microscopy is a methodology combining the functionality of light microscopy with the high resolution of electron microscopy and other microscopy technologies for the same biological specimen. In this paper, we propose an image registration method for correlative microscopy, which is challenging due to the distinct appearance of biological structures when imaged with different modali...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Lecture Notes in Computer Science
سال: 2022
ISSN: ['1611-3349', '0302-9743']
DOI: https://doi.org/10.1007/978-3-031-16446-0_11